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I. INTRODUCTION 

The advent of the high-speed digital computer has given numerical 
analysis a youthful vitality. In addition to the new activity resulting merely 
from the speed of the modern computer, there is also new numerical anal- 
ysis resulting from the digital computer's inherent flaw -computation in finite 
precision arithmetic. Who would guess that rounding in the eighth place 
might yield a result not even accurate in the first place? 

This Technical Note discusses the problem of finding bounds to the er- 
ror generated by roundoff. The technique used is perturbation-condition 
analysis defined in section III. Section II sets the stage for the subsequent 
discussion and discusses the terms "forward analysis, " "backward analysis, " 
"inherent error, " and "propagated error. " Section III then defines condition 
and the meaning and advantages of perturbation-condition analysis. The ex- 
amples in this section are all due to J. H. Wilkinson (with the exception of 
the Bauer-Fike Theorem), and the attempt to defjine condition as done in 
equation (1) is essentially an attempt to state formally what Wilkinson 
achieves when he does a perturbation theory. The justification for abstract- 
ing a definition in this way is the obvious success of Wilkinson's analyses. 

The latter part of section III discusses conditioning and the possible ways 
this may be done. 

Section IV is concerned with conditioning for the eigenvalue problem 
and discusses an algorithm developed by E. E. Osborne which is conjectured 
to be of use in conditioning matrices for eigenvalue computations. Results of 
numerical experiments by the author are given to evaluate the conjecture. 



II. PRELIMINARY NOTIONS 


Our task is to approximate some function F by computing with an al- 
gorithm A; we write Y = F(X) and Y = A(X) where X is a data vector and Y 
and Y are the solution vector and the approximating vector, respectively. 
Ultimately, we will be concerned with IIY-Yll where II II is a norm on the 
vector space containing Y and Y. Given X, we assume that A(X) is computed 
by a machine in a finite number of simple arithmetic calculations (addition, 
subtraction, multiplication, division) using finite precision; that is, each ma- 
chine number is essentially represented by a finite number of digits in some 
base (usually 2). The reader is assumed to be familiar with finite precision 
arithmetic and the rounding errors present in simple arithmetic calculations, 
although no specific knowledge is necessary (see ref. 1, pp. 1-33 for a 
complete discussion). 

Let us examine possible sources of the error E = II Y- Y H . Of primary 
importance is the error due to the propagation of rounding errors made at 
each simple arithmetic calculation while executing the algorithm A. We de- 
fine this accumulation of error due to roundoff simply as propagated error . 

A second type of error may arise because the vector of data X cannot be rep- 
resented exactly a_s finite precision machine numbers. In this case, we ac- 
tually have Y = A(X) instead of Y = A(X) where X is the machine representa- 
tion of X. Having noted this distinction, we will usually suppress it and write 
Y = A(X) since this will cause no confusion. We can place this second type 
of error in a more general setting. We define inherent err or as the error or 
uncertainty in X present before applying the algorithm A. For example, X 
may represent physical measurements with a stated uncertainty or, as above, 
X may not be representable exactly in the machine. 

There is an ambiguity in the distinction between propagated error and 
inherent error in the following sense. Suppose we compose two algorithms, 

A and B, and wish to compute (BoA)X = B(A(X)). Then, do we consider the 
propagated error in A(X) as inherent error to the algorithm B, or do we con- 
sider the inherent error in X as the only inherent error and propagated error 
as the total accumulated roundoff error? We note that although the distinction 
between inherent error and propagated error is real, it is empty if we cannot 
compare their importance in the expression of the error E = II Y-Y II . We re- 
turn to this question later. 

In dealing with the effects of roundoff error, there are two techniques 
of analysis. One approach seeks to compare the results of the computation 
A(X) to F(X) by bounding the error_at each simple arithmetic calculation to 
obtain a cumulative bound for IIY-Yll . This approach is known as forward 
analysis and, in general, such an analysis of a very complicated algorithm 
is exceedingly difficult and may give useless (far too pessimistic) error 
bounds. A good example of the analysis necessary in such an approach can 
be found in Todd's paper [2] which describes the forward analysis for an 
algorithm which finds square roots by Newton's method in fixed point arith- 
metic. 
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The other technique, developed by J. H. Wilkinson ( [l] , [3] ), is to 
show that the computed solution is the exact solution of some perturbation of 
the data; i. e. , that 

Y = A(X) = F(X+P), 

where P is a vector of perturbations belonging to the same space as X itself. 
The goal of this technique, called backward analysis , is to bound ||P|| ; hence, 
by backward analysis we consider roundoff error simply as "equivalent" to a 
perturbation P on X. In general, P depends on the algorithm A and the vector 
X; to make this dependence explicit, we will sometimes denote P by P^ ^ or 

Px* We note that if we desire a bound for the error, 

e = IIy-yII = ||f(x)-f(x+p)||, 

we need a perturbation theory for the function F; that is, we need information 
about the changes in F due to changes in the vector X. 

If we are primarily interested in E = ||Y— Y II , it may appear that the 
backward analysis-perturbation theory approach is the long way around. How^ 
ever, there are several advantages to such an approach. First, as Wilkinson 
has repeatedly shown, the approach is quite successful and easier than for- 
ward analysis. Secondly, a perturbation theory for the function F is desirable 
for analyzing the effects of inherent error; a perturbation theory gives us an 
indication of how sensitive the problem F is with respect to small changes in 
X. Finally, since backward analysis casts propagated roundoff error in the 
form of inherent error (because A(X) = F(X+P)), we are able to make a com- 
parison of the sources of error. For example, if we find the bound on IIP II 
to be much smaller than the uncertainty bounds on X, we are probably pre- 
pared to accept A(X) as a satisfactory approximation to F(X). However, if 
the bound on IIP II is greater than the uncertainty limits on X, the results 
may be regarded as dubious. Note that we are able to make these later state- 
ments without the use of perturbation theory. 
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III. CONDITION AND CONDITIONING 


Definitions 

Intuitively, the condition of the data vector X with respect to a function 
F would indicate the amount F could change, given a perturbation in X. We 
note the dependence on X and F and speak of the condition of X with respect 
to the problem F (e. g. , the condition of the matrix A with respect to the 
eigenvalue problem). Ideally, small changes in X produce small changes in 
the solution F(X). If this is not the case, that is, if relatively small changes 
in X produce large changes in F, we say that X is ill conditioned with respect 
to F. More precisely, we define a condition as a function, Cp: X—* (0, °° ), 
such that 

II F(X+P)-F(X) II ^ Cp(X)G( 1 1 P 1 1 ) (1) 

where G( II PH ) is a continuous, monotonically increasing function of IIPII such 
that G(0) = 0 and G(l) = a , a specified constant. (G might be a bound on IIPII . ) 
Given G, we note that Cp is not unique because any C'p such that C'p(X) 2* 

Cp(X) for all X (in some set under consideration) is also a condition. When 

we want to consider a condition with respect to a relative error, we write 
our defining relation as 


|| F(X+P)-F(X) 
II F(X) II 


$ Cp(X) G 



(2) 


when this makes sense. Naturally, in equation (1) and (2) we want a condi- 
tion such that the inequality (bound) is as sharp as possible, and sometimes 
we may be able to write equation (1) (and similarly equation (2)) in the form: 


l|F(X+P)-F(X) II = Cp(X) G( IIPII ) + Q(h n ) 


(3) 


where h <• 1. 

Essentially by finding a condition function Cp as expressed in equations 

(1) through (3), we have solved the perturbation theory problem for the prob- 
lem F. Corresponding to our intuition, we have defined a condition function 
to give an indication of the extent to which uncertainties may be propagated by 
F at the point X. We will call the analysis which results in equations (1) 
through (3) perturbation - conditio n analysis. Practically, we desire a func- 
tion Cp such that Cp(X) can be computed with relative ease. 

John R. Rice, in his paper, A Theory of Condition [4], defines condi- 
tion in a similar but more general way. Rice considers a mapping M from a 
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metric space (X^, P into a metric space (X 2 , P 2 ). In addition to the metric, 
each metric space possesses a size function d^ (i = 1, 2) which is a non- 
negative real valued function on the elements of X.. Schematically, we have 

M : (X r P x )- (X 2 ,P 2 ) 

dj : X i -* (0, «>). 

Note that an example of a size function would be a norm. 

In the set X., the sphere about x of radius 5 is defined by S.(x , 5 ) = 
l o J i o 

{ x | p^(x, x q ) < 6 } and the relative sphere is defined by Sj (x q , 5 ) = 

{ x | p^(x, x q ) <6 • d^(x Q ) ) • Using these notions. Rice defines absolute and 
relative 8 -conditions. The idea is as follows. Consider a sphere of 
radius 5 about x q in the set X^. Under the transformation M, this sphere is 
carried into some subset of X„, not necessarily a sphere, about M(x ). How- 
ever, suppose we consider a family of spheres about M(x q ) of radius a ■ 8 

( 8 fixed, 0 <r a °° ); that is, the family of sets 

S 2 ( o') = { x | p 2 (x, M(x q )) a 5 ). 

We expect that as <r increases, there will eventually be some o' such that the 
sphere S 2 (o') will be just large enough to contain the image of the original 

sphere S^; a 1 then gives us a measure of how perturbations in X^ (of magni- 
tude ^ 8 ) are propagated by M at x q . If we had considered relative spheres, 

c 1 would be a measure of how "relative" perturbations in X^ are propagated. 
Hence, Rice gives the following definitions: 

1. The ab solute and re lative 8 conditions of the transformation 

M : X i —*■ X 2 at the point x q * X^ are, respectively: 

M § (M,x q ) = inf {a | M[S 1 (x q ,8 )]c S 2 (M(x o ),*8 ) ) , 

u c (M, x ) = inf { a I M [ Sf(x , 8 )] c S?(M(x ), a 8 ) ) . 

0 O 1 o & o 
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2. The asymptotic absolute and relative conditions of M : -*■ X 2 

are, respectively: 

M (M, x Q ) = lim n s (M, x q ), 

5-0 

v (M, x q ) = lim v £ (M, x Q ). 

5—0 

The asymptotic condition is simply called the condition. The condition 
thus defined need not exist because n ^ and v ^ may oscillate as h — 0. If the 

condition does exist, however, it is unique because limits are unique. 

If the metric spaces (x^, P .) are endowed with differentiable structure. 

Rice proves that the absolute and relative conditions exist. The essential re- 
quirements are that: 

1. Xj and Xg be differentiable manifolds 

2. p^(x, y) be differentiable functions of x and y 

3. M be a differentiable mapping; M : X^— •- Xg 

4. There exist size functions d.(x) which are non-negative. 

The interested reader unfamiliar with the precise meaning of these require- 
ments will find the reference given in Rice's paper [4] useful. We note that 
these differentiability requirements are restrictive; verifying the requirements 
for a very complicated mapping (perhaps one that results from composite map- 
pings) might prove to be an impossible burden. 

We now return to equations (1) through (3) and continue the discussion of 
error bounds via perturbation -condition analysis; we will search for a condi- 
tion function Cp, by careful perturbation analysis. We shall not be dismayed 

by the fact that Cp, is not unique; our purpose is simply to find some condition 

function (hopefully computable) that will produce reasonably tight bounds which 
will be useful in the ultimate error analysis. 

Nothing has been said about the approximating algorithm A throughout 
the discussion of equations (1) through (3). This is because it is desirable to 
have a perturbation-condition analysis which is independent of the approxi- 
mating algorithm. The influence of the particular algorithm A comes via 
backward analysis. Consider^ again the problem of propagated roundoff error 
in computing A(X). Writing Y = A(X), we are led by backward analysis to 
consider: 
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Y = A(X) = F(X+P a x ) 


and the error, 

E - || Y-Y |! = ||F(X+P AjX )-F(X) II = C F (X) g(||p a ^ x ||), (4) 

supposing also that we have a perturbation-condition analysis. In order to 
evaluate E which gives the propagated error bound, we must evaluate 
G( ||P A x l|), and the algorithm A (and X) determines G( ||P A x ||). Thus, we 

desire an algorithm A for which G(||P||) is "small. " If G(||P A x l|) is large 

(how large would be determined by the particular problem), we say that the 
algorithm A is unstable at X. If 

G <l |P B.X ll ^ G <l' P A,X li) < 5 > 

(equality not holding for all X) for some other algorithm B, then B is more 
stable than A; in choosing the approximating algorithm, we desire as stable 
an algorithm as possible. We see that a backward analysis of an algorithm 
gives us insight about its stability and also that the condition of F at X and 
the stability of A at X essentially determine the propagated error bound. 

Examples 

We now proceed to give some examples of perturbation-condition anal- 
ysis. Essentially, we follow Wilkinson's analyses given in [l] and [3]. 

Ro ots of Polynomials. — Consider the space of polynomials of degree 
n and let 

n 

p(x) = 2 a.x 1 , a ^ 0. 

i=l 1 n 

th. 

Suppose that the r zero of p(x) is simple and that the problem is to find 
x r ; x r = F r (p) * Let 

n 

c q(x) = 2 b.x. 

i=l 1 1 

be a perturbation of the polynomial p(x) where e is a scaler and + h = 
F r (p+«q); we want a bound |h| = |F r (p)-F r (p+ «q)| . Since x f + h is a root 

of ( p+ « q] (x), we have 


7 
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( 6 ) 


0 = [p+eq](x r +h) = p(x r +h) + e q(x r +h) 


n 

= 2 
k=l 


h r 


k! 


p (k) ( Xr> ) + « 


n 

2 

k=0 


k! 



(x r ). 


using that fact that p(x ) = 0. Using the algebraic theory of functions (see 
ref. [3], pp. 64-66, we may write the following expansions: 


x + h 
r 


x + 
r 


00 

2 

3=1 


a e 3 

J 


since x r is simple. If x^ has multiplicity m, we have 


(7) 


x + h = x + L (8) 

r r 3=1 3 

Equations (7) and (8) are convergent for sufficiently small e and hence only 
make sense for « < some e . Substituting the expansion for h in equation 

(7) into equation (6), we obtain: 



(9) 


Since this equality holds for all e < e Q , the coefficient of e must vanish; we 
obtain 


a l p(1) (x r ) + q(x r ) = 0. 


SO 


_ -q( x r > 

11 = p 717 ^) 


Finally, substituting equation (10) into equation (7) gives 


h = 


q(x r )e 

P (1) (x r ) 


+ 0(0 


( 10 ) 
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for € small enough. Hence 


1 h 1 = 

|F r (p)-F r (p+«q)| 


q(x r )« 

+ o( € 2 ). 

(11) 

I n | 


P a, (x r ) 

showing that 

we may consider 

! P (1) (x r ) r 1 

as a condition. 

K x is a zero of 
r 


multiplicity m, the algebraic theory of functions gives the similar result that 


|h| = |F r (p)-F r (p+«q)| < 


m! q(x >, 1/m 


P <m, (xJ 


+ o(. 2/m ) 


for e sufficiently small. 

Line ar Equations . -- Let the matrix A be in the space of nxn matrices 
and the vectors x and b be of dimension n. Given A and b, the problem is to 
find x satisfying Ax = b. Supposing A to be non-singular, we know 

x = A For fixed A, consider a perturbation in b yielding the equation 

A(x+x') = b + b'. (12) 


Since Ax = b, we have immediately that Ax' = b' or x' = A ^b'. Thus, 


x* A 


-1 


b'||. 


(13) 


assuming the matrix norm is consistent* with the vector norm. Using 
<r II A II * || x |L we obtain the relative error bound. 


^ A 


-111 H b ' 

A 


II x II ll b II 

showing that we may consider 


C L (A;b) = A 


-H 


(14) 


(15) 


*A matrix norm is consistent with a vector norm if |Ax || <: || A || |x | for all 
A and x. s 
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a condition. 


Now let b be fixed and consider a perturbation E on A, giving the equa- 
tion. 


(A+E)(x+x') = b. (16) 

From Ax = b, we have 

(A+E)x* = -Ex. (17) 

Although we have assumed that A is non-singular, A + E may be singular un- 
less E is restricted. Writing 

(A+E) = A(I+A -1 E), (18) 

it follows that A + E is non- singular if 

||a _1 e I < 1 . * 

Assuming || A *E | < 1, we have 

||(I+A“ 1 E)“ 1 1 ^ (1 - || a _1 e|| ) -1 (19) 

(expand (I + A _1 E) 1 in an infinite matrix series. Using equations (17) and 
(18), we see that 

x' = -(I+A" 1 E)" 1 A -1 Ex (20 


*Proof: It suffices to show I + A ^E is non-singular, which is true if I + A *E 
has non-zero eigenvalues. Letting X and y be an eigenvalue and eigenvector of 
A *E, respectively, we have 


X 



(A _1 E)y | «= || A _1 E ||- || y 


for a pair of consistent norms. This implies that | X 
hence, the eigenvalues of I + A 1 E are all non-zero. 


< 


A _1 E | < 1; 


Q. E. D. 
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and from equation (19), 


I x' |« l|A-1 1 H Nil H s 2 (I A -1 |j ||E|| ||x|| . 

1 " 1- II A -1 E H 1 -II A" 1 # IlEll l; 11 J 11 


assuming further that || A *|| ||e|| < 1/2. Finally, 


x ! 


!— V 2| A | || A' 1 B If!! 
II * « II A|| 


= C l (A 


»> U™) . 

\ II A ll / 


( 21 ) 


( 22 ) 


giving again the condition Cj^. Note that we have assumed that ||l|| = 1 (I, the 

identity matrix) to obtain equation (19). For example, if ||x|| g = (x*x)^ 2 
(x the conjugate transpose of x) and 


|| A | g = (max | X .(A*A) j) 1 ^ 2 


(X^(A*A) the i** 1 eigenvalue of A* A), then || 1 1 | 2 = 1 and || Ax| ^ < ||A|| ^ || x|| 

so equations (14) and (22) are valid. K we wish to consider a total perturba- 
tion, (A+E)(x+x') = b + b' , on the system, we can derive 


2C l (A) 



if II A 



E <1/2 by a similar analysis. 


(23) 


Consider the system of linear equations given by 


H ? x 


e 


7 


(24) 


where 


h ij = j = 


7 


11 



and 


e ? = (0, 0, 0, 0, 0, 0, 1) T . 

We consider the perturbed problem where the h.^ are represented to 8 decimal 

digits of accuracy (one floating point word in an IBM 7094). The computed 
solution using a Gaussian elimination scheme and the exact solution, which is 

JLl_ ^ 

the 7 m column of , are compared in Table I. The exact solution is given 
by the formula (ref. [ 5 ], p. 23): 


/ H ~l\ = (~l) 1+:i (n+i-1) ! (n+j-1) ! 

V 7 / ij (i+j-1) [(i-DKj-l)!] 2 (n-i) ! (n-j) ! * 


(25) 


TABLE I 
H 7 x = e 7 


Exact Solution 

Computed Solution 

12012 

17793. 570 

-504504 

-732827.38 

5045040 

7225442. 5 

-20180160 

-28597667. 

37837800 

53182954. 

-33297264 

-46496295. 

11099088 

15416434. 


The matrix (h..):h.. = (i+j-l) is known as the Hilbert matrix and a 

V J 

finite segment of the matrix, i, j = 1, . . . , n, is ill-conditioned with respect 
to the inversion (linear equations) problem. Since a finite Hilbert segment 
is a symmetric matrix, equation (15) reduces to 


max | X ^(A) | 

C = — (26) 

min | X. (A) | 
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if we use the || norm defined previously. For the Hilbert segment of order 

n, log C L ~ kn where means asymptotically equals and k = 3. 5 (ref. 

[ 5] , p. 23). Hence, the inaccurate results shown in Table I are not unex- 
pected. 

The Eigenvalue Problem. -- A is again a member of the space of nxn 
matrices. The problem is to find the n numbers X such that Ax = X .x for 

some x in the linear space of dimension n over the complex field. We know 
this is equivalent to finding the roots of the characteristic polynomial of 
degree n defined by 

det(A-XI) = 0. 

We will consider two different perturbation analyses. 

1. Bauer-Fike Theorem 

Suppose A is a diagonalizable matrix. Then there exists a matrix C 

such that C X AC = A where A is a diagonal matrix of eigenvalues. Let 
\ 4 be an eigenvalue of A + « B, B arbitrary, and t a positive scaler. The 

matrix (A+«B- X ( I) is then singular and 

C -1 (A+«B- X € I)C = (A -X e I) + €C -1 BC. (27) 

Since the determinant of the matrix on the left side vanishes, so must the 
determinant on the right. Suppose first that it is not the case that = X^ 

for some i. Then, from equation (27), we have: 

(A-X e I) + «C -1 BC = (A -X € i)[l+«(A -X € I)" 1 C" 1 BC] . (28) 

Since the determinant on the left side vanishes, the determinant of 
[l+«(A -X € l) *BC] vanishes by our supposition. By the discussion as- 
sociated with equation (19), 

|| * ( A - X e I) _1 C“ 1 BC|| 2 ^ 1, 

since the || || ^ norm is consistent. Thus, 

.|(A-X, 1 )- 1 || 2 || C - 1 || 2 || B ||2||C|| 2 S 1. 
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Clearly. 


So 


| (A - \ ( I)" 1 || 2 



1 


min x 
i 



min 

i 


X X <: 

i t 1 " 



|c|| 2 h.||b||. 




( 29 ) 


Finally, if it were the case that X^ = X^ for some i, then equation (29) holds 
trivially. Thus, we have proved the following: 


Theorem (Bauer, Fike): 

Let A be a diagonalizable matrix with C *AC = A . Then the eigenvalues 
of A + eB are contained in the union of the discs 


M 



< 




where the matrix norm is consistent with a norm on the eigenvectors and is 
such that 


D = max d. 


for any diagonal matrix. 

The proof we gave used the || || 2 norm for convenience. A glance back 

is sufficient to see that it holds for other norms fulfilling the stated conditions. 
It also holds for the Euclidean norm: 



because ||A ^ $ A for all nxn matrices. 


(30) 


Notice that we do not assume that t is small in this analysis. However, 
since eigenvalues are continuous functions of the elements of A, we have the 
following extension of the theorem: 










If m of the discs 

m-x a 


c 1 


c 

€ 

B 


form a connected set disjoint 

from the other discs, then the union of these m discs contains exactly m eigen- 
values of A + e B. 
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Hence, if e is small (consider B normalized 
more precise error bounds; how small « must be. 


so b. . •$ 1), we obtain 
we don't know a priori. 


The proof shows that given an eigenvalue A of A + <B, there exists an 

€ 

eigenvalue of A (say, A .), such that 




ll C ' l |l 2 ll C ll 2 *I|B||. 


(31) 


Equation (31) is not exactly in the form of equation (1); letting F.(A) 

th. ^ 

be the 1 eigenvalue, we have, in general. 


F i (A+ e B) - F i (A) 


5 


(2n-l) 




c 



(32) 


because F^(A+eB) can be contained in any of the discs and none of the discs 
may form a connected set disjoint from the remaining discs. 


Equation (32) shows that we may consider the quantity C^(A) = ||C *|| 2 II 1 1 2 

a condition for the eigenvalue problem. Since C is only determined up to 

multiplication by a non-singular diagonal matrix (because (CD) ^A(CD) = A ) } 
we could consider 

Cfc<A> - g.l.b. j l| C _ 1 1| 2 1| C ll^ | C-'AC - A j 
as a condition. 


2. Wilkinson Perturbation Theory 

We now give a brief account of Wilkinson's perturbation theory for the 
eigenvalue problem. 

Let A^ be an eigenvalue of A. Then there is a vector x.. such that Ax. = 
T T T 

X.x. and a vector y. such that y. A = y. X.. We normalize so that 
11 J i J i J i 1 

H x ill 2 = II yj 2 = 1 - 


Let 


s. = y. x.; 
1 “ 1 1 


( 33 ) 
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then 



(Cauchy's inequality). 


and hence. 



> 1 . 


When A has simple eigenvalues, 1/| s^ | is uniquely determined for each i. 
When this is not the case 1 / 1 | may not be uniquely determined for A., 
(because there may be multiple eigenvectors associated with X^), but we can 
T 

choose some y^ x.. corresponding to 


Let A be diagonalizable and consider again the perturbed problem A + «B 
(where B is normalized so that b. . $ 1). Wilkinson ( [3] , p. 69) has shown 

J 

that the perturbation in the eigenvalue A^ of A due to the perturbation eB in A 
satisfies the relation. 


I A.<0-A.| 


k c 
s. 


+ 0 ( 0 , 


(34) 


when e is sufficiently small and A^ is a simple eigenvalue of A-. Here, k $ n, 

n the order of A. For multiple eigenvalues of a diagonalizable matrix and 
for eigenvalues of matrices which are not diagonalizable, | A ^( e ) - A.| still 

depends inversely on |s^| but the bound is not so good as in equation (34) 

(see ref. [3], pp. 72-81). 

Equation (34) indicates that we may consider 1/ | sj as a condition for 
\ ... The numbers 1/ | sj are relatively easy to compute because they are 
calculated easily from the eigenvectors. In fact, the quantities s^ are invar- 
iant under unitary similarity transformations;* thus, if one finds the eigen- 
values by upper triangularizing by unitary transformations, finding the eigen- 
vectors is essentially only a matter of back- solving the triangular system of 
equations. 


^Similarity transformation using a unitary matrix; i. e. , a matrix U such that 
U*U = I. 
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There are some relations between the condition number 1/ | s^j and the 

condition number ||c 1 1| 2 II ell 2 of equation (32). Wilkinson shows ( [3] , 
pp. 88, 89) that 

C e (A) = II C _ 1 1| 2 II C II 2 ^ 2 


and 

1 

I I ^ c E tA) for 311 i * 


These examples of perturbation-condition analysis show that the pri- 
mary restriction of the analysis is that we must usually assume that IIPlI in 
equation (1) is small, but we don't really know how small. This was clearly 
the case in the polynomial problem (1) and in Wilkinson's perturbation theory 
giving rise to the quantities 1/ |s.| . It was also true in the linear equation 

problem because we were required to asstime that || A *|| ||e|| <" 1/2. (This 

was somewhat of a convenience but we at least had to assume that || A '*’E|| < C 1 
to obtain a bound at all. ) We placed no restrictions on ||b'|| to derive equa- 
tion (14), but Wilkinson points out that equation (14) can be grossly pessimis- 
tic when || A|| 1 1 A *|| is large. The bound given by the Bauer-Fike theorem 
expressed by equation (32) was independent of the size of « IIb|| , but we point- 
ed out that an extension of the theorem gives better bounds if < is small 
enough. It may happen that the required smallness of ||P|| or ||P||/||X || 
depends inversely on C(X); for example, in the restriction that 

II A _1 || || E || = C, (A) — <-| 

L II A || 2 

in the linear equations problem. Thus, if C(X) is so large that our perturba- 
tion theory breaks down, we no longer know what C(X) precisely indicates. 

C onditioning 

Let us return again to the general setting and consider the function F 
and the algorithm A used to approximate F. We suppose we have a perturba- 
tion-condition theory for F and a backward analysis of the algorithm A. 

Given the data vector X, we are attempting to find a bound on the error E by 

e= ||y-y|| ^c f (x) g(||p A jX ||). 


s. 

l 


(35) 
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By the indifference class determined by X, we mean a set of vectors I (in the 
same space as X) such that if X' is in I, then A(X') and A(X) are considered, 
a priori, equally good approximations. In a sense, the indifference class may 
be regarded as a class of input candidates. We might then think of using some 
X' in the indifference class determined by X such that 

C p (X') G(||p^ x ,|| ) < C p (X) G(|| P A< x || ) (37) 

(or preferably using X' such that C F (X') G(IIp a x , II) was minimum over I 

if such an X' is possible to find) in order to attain a better bound. The 
process of choosing an X' such that equation (37) holds will be called condi- 
tioning. Three possibilities come to mind: 

1. Consider the indifference class determined by I = (X'|F(X) = 

F(X')} and T a transformation on the space containing X such that T(X) 
and X are in I. Then, given X, we wish to choose such a T(X) that 
equation (37) holds. 

2. The indifference class is the set I = { X'l II X-X' ||< * } for some < . 
Here, e might be a measure of the inherent uncertainty in X; we wish 
to choose an X' « I such that equation (37) holds. 

3. The indifference class is the set I = { X* | ||X-X' || « min( j|P A x |], 

II Pa x , II)}. In this case, we seek the relation (equation (37)) by per- 
turbing X to such a slight degree that the change is much smaller than 
the backward analysis perturbation generated by rounding errors. In 
the case that X comes from measured data with uncertainty, we as- 
sume (3) is merely a subcase of (2). 


For the remainder of this paper, we will investigate conditioning for 
the eigenvalue problem using the framework of (1) above. Given X, we will 
determine a diagonal matrix D with entries d.. and the similarity transforma- 
tion, DXD 1=X'. Clearly, F(X) = F(X') if the similarity transformation is 

done exactly. To ensure this, the entries d. of the diagonal matrix are all of 
+ ^ 

the form 2 (t integer). We note that diagonal similarity transformations are 


simple, non-trivial similarity transformations; (DXD 1 ).. = d. X../d.. In the 

^ y 3 

next section, we discuss how D is computed and the conjecture that such con- 
ditioning leads to smaller error bounds and, indeed, to more accurate com- 
puted results. 
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IV. CONDITIONING BY NORM REDUCTION 


In his paper [ref. 6] , On Pre-Conditioning of Matrices, E. E. Osborne 
suggests that if the eigenvalues of a matrix are small, relative to its norm 
( || || 2 norm), then the eigenvalue calculation may be ill-conditioned. Thus, 

Osborne develops an algorithm which reduces the Euclidean norm to its 
g. 1. b. o by a sequence (possibly infinite) of diagonal similarity transforma- 
tions. * B. N. Parlett [ref. 7], who has written an eigenvalue routine based 
on his research of the QR algorithm, has also conjectured that norm reduc- 
tion may improve the computation and gives the user the option of calling a 
norm reduction subroutine (slightly different from Osborne's) before using 
the QR algorithm. We will examine the conjecture that norm reduction can 
be used to condition matrices for the eigenvalue problem and present some 
results from numerical examples using Osborne's algorithm and Parlett' s 
eigenvalue routine. 


The Algorithm 

We consider reducing the Euclidean norm of the matrix A, 

1/2 


Ml 


E 



(38) 


.-1 


by diagonal similarity transformations, DAD . Let D^ be a diagonal matrix 
whose entries are d. = l for j^i and d.^1. The effect of using such a matrix in 

^ th 

a similarity transformation is multiplication of the i row of the matrix A by 
d^ and multiplication of the i** 1 column of A by l/d. (the a„ entry is invariant). 

2 2 

Let the quantities R^ and CL be defined on A by 


R x 2 = 


2 

ik 


a. . 


(39) 


^Because — ||a|| || A|[ 2 $ ||A|j^, a substantial reduction of the II II 


^ - ii E II “'I 2 ~~ II HE* 
norm will yield a reduction of the || [L norm. 


E 
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and 



( 40 ) 


Using the matrix D. defined above in a similarity transformation leads us to 
the quantity: 

Q(d.) = d 2 R 2 + C?/d?. (41) 

If we choose d. in such a way that Q(d.) ~ Q(l) * we will have reduced the 
Euclidean norm. Clearly, Q will be minimized when 

d. = (C./R.) l/2 ; (42) 

then 

Q(d.) = 2C.R. (43) 

and 

Q(l) - Q(dj) = R 2 + C 2 - 2C i R i = (R.-C.) 2 >0. (44) 

Hence, the transformation reduces the norm. This process is repeated using 
matrices for i = 1, . . . , n, which is a cycle; i. e. , for each i, d.. is com- 
puted from equation (42) following the previous similarity transformation. 

The result of the cycle is the same as a diagonal similarity transformation by 
the matrix. 


D = d n d n-i * 


D 


1 ’ 


(45) 


which has diagonal entries d^ of equation (42). Since a similarity transforma- 
tion of the form ° I ( c f 0) leaves the matrix invariant, we normalize D by 
dividing each d. by d^; i. e. , setting dl = d^/cL^. Since the norm is mono- 

tonically decreasing with each cycle, the norm converges and d! — * 1 for all i 
in cycle kask-*«; convergence implies R^ = for all i and we see that the 


*For convenience in this discussion, we allow the mixed inequality $ to mean 
reduced rather than the usual strict inequality c. 
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I 


algorithm has "balanced" the matrix. We have assumed implicity by using 
equation (42) that ^ 0 and Ck / 0. If the matrix A is irreducible, this is 

surely the case; and Osborne shows, in addition, that irreducibility implies 
that the dl of each cycle is bounded by M independent of the cycle k. ^See 

ref. [6] for this and other theoretical details. J 

We noted in discussing condition functions for the eigenvalue problem 
that for the quantities s. we had 1/ | s^| > 1. For the condition 

II C 1 1| 2 || C|| 2 of equation (32), we have the inequality. 


l|c “ 1 || 2 || c || 2 ^ II C - 1 C || 2 = ||l || 2 = 1 . 

If the matrix A is real and symmetric, 1/ |s^l = 1 for all i and C can be 

T 

chosen such that C C = I, and hence 

ll c “ 1 H 2 l|C || 2 = 1 . 

Thus a symmetric matrix is well -conditioned (perfectly conditioned) with 
respect to the eigenvalue problem. 


y* 2 

For an arbitrary real matrix A, let . ^ (a._.-a_..) be a measure of 


the symmetry of A. Expanding, we find 


U 3 ij Ji 


A W 

i, 3 J J 


2 af. - 2 2 a. . a... 

X3 ifj U 3 1 




(46) 


i<3 

Under the sequence of diagonal similarity transformation used in Osborne's 

2 

algorithm, the quantity, 2 2 a., a.., remains a constant, while 2 a. . is 

i-^j 1;} ‘ )1 1J 

the only part of the norm which changes and it must decrease unless it is al- 
ready a minimum. Thus, Osborne's sequence of similarity transformations 

2 

makes 2 (a.. -a..) as small as possible; i. e. , it makes the matrix as sym- 

i-~j - 11 

metric as possible. Hence, there is reason to believe that this algorithm can 
be used to condition real matrices. 
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Practical Algorithm 

A Fortran IV subroutine was written to execute Osborne's algorithm 
with the restriction that each cL be of the form 2* (t integer), so that multi- 

l/2 

plication by d. and l/d. would be exact. Thus, after the quantity (C./R.) 

11 t 

is computed, we wish to find t such that |(C i /R.)-2 °| is as small as pos- 

t Q 

sible and such that we always have Q(l) - Q(2 ) ^ 0; i. e. , the norm is al- 

ways reduced. Figures 1 and 2 show there are two cases. 

One can easily verify that the following rule gives the desired d^: 

t . / Q 

(1) If C i /R i ^ 1, choose to such that 2 0 <■ (Ch/R^) ' and 
^(C./R.) 1/2 - 2 

Q(d.) = d 2 R 2 + C 2 /d 2 

FIGURE 1 = — FIGURE 2 



(2) If C./R^ < 1, choose to such that 2 0 > (C^/R^) 1 ^ 2 and 
^ 2 0 - (Cj/R^)^ 2 ^ minimum. 
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We cycle until d! = 1 for all i. Note that dj = 1 if (C./R^ 1 ^ 2 «Q, 2^; 

i. e. , if 1/4 < C^/R^ < 4. If the matrix A may be irreducible, checks can be 
established to determine whether C. = 0 or R. = 0 or d.^ is so large (or small) 
that overflow may eventually occur. 

The Experiments 

An outline of the procedure used in the numerical experiments is given 
below. All computing was done on an IBM 7090. 

1. Various types of matrices with real entries were generated; the en- 
tries were built with the use of the random number generator. The order 
of the matrices was usually a random integer n with 5 ^ n $ 25. 

2. The eigenvalues of the matrix A generated as described in (1) are 
computed using Parlett's QR routine in double precision . No norm re- 
duction algorithm is used. The first eight digits of these double preci- 
sion eigenvalues are regarded as the "true" eigenvalues. 

3. Next, the eigenvalues of A are computed using the QR routine in 
single precision. In addition to each eigenvalue, X^, the condition num- 
ber 1/ | s^ | is computed; the condition number routine is part of Par- 
lett's program. No norm reduction is done. 

4. Finally, the matrix A is "balanced" (norm is reduced) using the 
algorithm described in the first two subsections. The eigenvalues of 
the balanced matrix and their condition numbers are computed in single 
precision, using the QR routine. 

By assuming that the double precision eigenvalues are accurate, we can 
investigate the results of norm reduction (by Osborne's algorithm). In addi- 
tion, the condition numbers can be compared before and after using the al- 
gorithm. 


Numerical Results 

The numerical results are listed below: 

1. Matrices have been found* which show that the norm reduction al- 
gorithm has resulted in a loss of accuracy of the computed eigenvalues 
relative to the accuracy attained when the eigenvalues were computed 
without previous norm reduction. Cases have been found for which the 
loss of accuracy was severe. Of some, interest, but rather enigmatic, 
is the fact that there are examples where the sum of the condition num- 


*See Appendix A 
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bers, S | s . | , of the eigenvalues decreases because of norm re- 

i 

duction but where there is, nevertheless, loss of accuracy. On the 

other hand, there are examples where the quantity, 2 |s| \ in- 

i 

creases but where the accuracy improves. In general, the conjecture 
that norm reduction can be used to condition matrices for the eigen- 
value problem by improving (or at least not reducing) the accuracy of 
the computed eigenvalues appears to be false. 


2. Matrices have been generated* such that the quantities (C^/R^) of 

equations (39), (40) and (42), i = 1, . . . , n, are initially large; that 
is, matrices were generated which were "unbalanced. " The matrices 
were generated (and tested) in a sequence such that successive matrices 
were (usually) more unbalanced than their antecedents. It was found 
that as the matrices became more unbalanced, there was a point after 
which balancing always improved the accuracy of the eigenvalues. As 
the matrices become very unbalanced (the upper triangular entries 
being many orders of magnitude in absolute value greater than the low- 
er triangular entries), substantial improvement in the accuracy has 
been observed, as well as a decrease (orders of magnitude) in the con- 


dition numbers 


-1 


For only slightly unbalanced matrices, we find 

again sometimes a loss of accuracy. It appears that matrices can be 
conditioned using Osborne's algorithm if they are poorly balanced, but 
the question of determining when a given matrix is poorly balanced re- 
mains unanswered. 


*See Appendix A 
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V. CONCLUDING REMARKS 


As mentioned in section III, the purpose of conditioning is to find a new 
representation of the input vector X which appears to be less susceptible to 
roundoff error. However, when we consider conditioning as described in sec- 
tion III (Conditioning, No. 1) (as we did in the eigenvalue conditioning dis- 
cussed in section IV), care must be taken in interpreting the results. For 
example, X may be data from physical measurements with a stated uncer- 
tainty. If X is very ill-conditioned, the data may be physically meaningless 
because the uncertainty in X may be magnified to such a degree that the un- 
certainty in F(X) is unsatisfactory. Thus, even though we may have been suc- 
cessful in finding a T(X) whose condition is acceptable, the inherent error and 
the condition of the data X render the computed results meaningless. While 
we look for means of conditioning the problem to avoid roundoff catastrophic s, 
we must be aware of the inherent limitations of the problem, which we can in- 
vestigate by perturbation- condition analysis. 

A common criticism of error analysis which attempts to give an error 
bound as we have done is that the bounds are usually far too pessimistic, be- 
ing very rarely, if ever, attained. Some of these critics go further to say 
that data arising from physical observations are usually well-conditioned and, 
if not, perhaps the problem can be "reformulated" to yield more computable 
data. The author finds such criticism naive but not totally unfounded. The 
whole crux of the matter is the detection of an ill-conditioned system — it is 
only then that we know that we must try to "reformulate" the problem, and 
the price we must pay for this knowledge is the occasional (needless) con- 
cern over problems for which the error bound was too pessimistic. This 
dilemma is difficult because, stated in another way, it is: how do we know 
the computed results are definitely poor unless we know the true results? 


National Aeronautics and Space Administration 
Electronics Research Center 
Cambridge, Massachusetts, April 1967 
125-23-03-05 
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APPENDIX A 


Presented here are two examples of the numerical results discussed in Sec- 
tion IV (Numerical Results). The first sample matrix is an example of 
severe loss of accuracy because of the balancing. The second sample matrix 
is one which is very unbalanced; the strictly lower triangular entries are 
much greater than the upper triangular entries. Note the additional digits 
of accuracy attained by using the balancing algorithm. 
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EXAMPLE 1 


INPUT MATRIX 


0 • 35638489E 03 

-0 • 78289724 E 02 

-0.45114718E 04 

0.98283312E 03 

0*121 19243E 05 

-0 . 2635 2130 E 04 

0 • 27 190309E 02 

-0 • 57 160737 E 01 

0*2878 5958E 04 

-0.62619318E 03 

-0.16U5408E 04 

0 • 3 5034536E 03 

0 *83809013 E 03 

-0 *18301350 E 03 
0.23866656E 05 

-0 • 5 1945000 E 04 

-0 • 4104 269 9 E 04 

0 • 892 33998 E 03 

-0.12769685E 04 

0*279951896 03 

-0.72778546E 04 

0 • 158 29492 E 04 

-0.27941597E 04 


0*16 145126E 03 

0.2395U63E 03 

-0.20395140E 04 

-0*300 1 1729E 04 

0 • 54 560247 E 04 

0 *80450521 E 04 

0*11 897345E 02 

0*18 28 1752 E 02 

0 • 1 2963992E 04 

0*19 113261 E 04 

-0.72540471E 03 

-0 • 10 69 5694E 04 

0*37 817148E 03 

0.55B16212E 03 
0 • 10 74844 1 E 05 

0*158581 19E 05 

-0.18476706E 04 

-0.27195816E 04 

-0 • 57 886086E 03 

-0.85C84720E 03 

-0 *32 772178E 04 

-0*48 331057 E 04 

-0*12 579061 E 04 


-0*1 2566398E 03 

-0.62719952E 02 

0 • 1 5801 004E 04 

0.79401387E 03 

-0 • 42328444E 04 

-0*212767 HE 04 

-0 • 963 56463E 01 

-0.48664072E 01 

-0.10061981E 04 

-0 • 50539338E 03 

0 • 562 89629E 03 

0 • 28284543E 03 

-0.29393447E 03 

-0.14752865E 03 
-0 . 83435334E 04 

-0.41893987E 04 

0*143 3 5 596E 04 

0.71997628E 03 

0 • 45005450E 03 

0.22576849E 03 

0.25437483E 04 

0*127 80 191E 04 

0.97626848E 03 


-0 • 88 599348E 03 

-0.35411067E 03 

0* 1 11297 1 IE 05 

0 • 44505269E 04 

-0.2982517QE 05 

-0.11922704E 05 

-0 . 65479804E 02 

-0 • 26273734E 02 

-0 • 70865974E 04 

-0* 28333291E 04 

0* 3965058 IE 04 

0 • 15B49654E 04 

-0 • 20701 668E 04 

-0.82816595E 03 
-0.58782556E 05 

-0.23501475E 05 

0 • 1009631 1 E 05 

0* 40363073E 04 

0*31 607834E 04 

0.126765826 04 

0.17918236E 05 

0*7 1 631 293E 04 

0 • 6877592 3E 04 


0 .6247651 2E 03 

-0 • 421 8291 4E 02 

-0.78429864E 04 

0.530 1161 4E 03 

0.210 17548E 05 

-0 • 14206603E 04 

0 • 47097 29 IE 02 

-0 .31401 047E 01 

0 • 4995270 3E 04 

-0 . 3375751 6E 03 

-0 *2794488 66 04 

0.188864526 03 

0 • 14589684E 04 

-0.986051106 02 
0.41427157E 05 

-0 • 27995684E 04 

-0 * 71 1 48 299 E 04 

0 • 4809586 8E 03 

-0.22280816E 04 

0 • 1507877DE 03 

-0 • 1262690 5E 05 

0 • 85347079E 03 

-0 .4846641 7E 04 


-0.306744566 03 

0 • 38562729E 04 

-0 • 10333220E 05 

-0.23019275E 02 

-0 • 24549 1 38 E 04 

0 • 1 3750724E 04 

-0 « 7 1730963E 03 
-0.20364297E 05 

0 • 349798 20 E 04 

0 • 10959891 E 04 

0 . 620789136 04 

0 • 2 38269 5 1 E 04 


-0 • 83073807 E 02 

0.10473419E 04 

-0 .280444646 04 

-0. 59740605E 01 

-0.66661491E 03 

0 . 37278906E 03 

-0 • 198 21438E 03 
-0. 55268602E 04 

0 • 949 52824E 03 

0. 299643 58 E 03 

0 • 168 50343E 04 

0 • 64658492 E 03 


0. 60753953E 03 


-0.18552938E 04 


0 • 490 532 68E 03 


0.27492572E 04 


0 • 32738 37 6E 03 



EXAMPLE 1 (Concl d.) 


EIGENVALUES CALCULATED IN DOUBLE PRECISION 

REAL PART IMAG. PART 

0 • AO 1 792705 E OC 0. 

-0.509963576E 01 0. 

-0 . 60A6A6A3 1 E 01 0. 

0 . 39A218910E 01 0. 

-0.279627556E 01 0. 

-0.326782623E 01 0. 

0 • 1971 A9999 E 00 0. 

0.1A9078507E 01 0.3A580088AE 00 

0.149078507E 01 -0 . 3A 580088 AE 00 

-0.187500820E 00 0. 

0.137500040E 01 0.37A999166E 00 

0.137500QA0E 01 -0 . 37 A999166E 00 

EIGENVALUES WITHOUT BALANCING 


REAL PART 


IMAG. PART 



CONDITION 

0.40237550AE 

00 

0 . 


0 . 

0.858AE 

05 

-0 . 50990295 AE 

01 

0 . 


0 . 

0.2032E 

05 

-0.604687929E 

01 

0. 


0 . 

0.2251E 

05 

-0.326759685E 

01 

0 . 


0 . 

0.2671E 

04 

0 • 3941992 17E 

01 

0 . 


0 . 

0.3871E 

04 

-0.279650316E 

01 

0 . 


A. 

0.8919E 

04 

0.197615832E 

CO 

0 - 


0 . 

0.8871E 

05 

-0.187748268E 

00 

0. 


0 . 

0.3517E 

02 

0 » 149038527E 

Cl 

0.3A3749814E 

00 

0 . 

0.6235E 

04 

0 • 149038527E 

01 

-0.343749814E 

00 

0 . 

0.6235E 

04 

0 • 137540306E 

01 

0 • 3 750068 A7F 

00 

0 . 

0.170AE 

02 

0.137540306E 

01 

-0.375006847E 

00 

6. 

0.1704E 

02 


NORM OF MATRIX BEFORE BALANCING IS 0.10247401E 06 


NORM OF MATRIX AFTER BALANCING IS 0.33216301E 05 
NUMBER OF ITERATIONS IS 2 


EIGENVALUES WITH BALANCING 


REAL PART 


IMAG. PART 


CONDITION 

-0.50117L076E 

01 

0. 


0. 

0.65A0E 

04 

-0.616425733E 

01 

0. 


0. 

0.7160E 

04 

-0.322168589E 

01 

0.2 1914491 IE 

00 

0. 

0.1859E 

04 

-0.322168589E 

01 

-0.2 19 14491 IE 

00 

0. 

0.1859E 

04 

0.376535038E 

01 

0. 


5. 

0.1527E 

04 

-0.243426405E 

00 

0. 


0. 

0.2641E 

04 

0 • 16420508 5E 

01 

0. 


0. 

0.7034E 

04 

0. 13833645AE 

01 

0.380440623E 

00 

0. 

0.2896E 

04 

0 • 13833645AE 

01 

-0.380A40623E 

00 

0. 

0.2896E 

04 

0.137554485E 

01 

0.374816835E 

00 

0. 

0.1704E 

03 

0 • 13755448 5E 

01 

-0. 37A816835E 

00 

8. 

0.1704E 

03 

-0. 18750641 5E 

00 

0. 


A. 

0.1955E 

01 


to 

CO 



EXAMPLE 2 


INPUT MATRIX 


0.20534179E 00 
0.33576850E-01 
G.21245116E 06 
0.22345185E 00 
0.24779558E 06 
0.22165299E 00 
0.25349575E 06 
0.44725644E-01 
0.23517094E 06 
0* 16198951 E 00 
0. 256956I2E 06 
0.24034906E 00 
0.2547969 2E 06 
0.2457846IE 00 
0.25984413E 06 
0* 73248468E-02 
0. 5072 3074E 05 
0. 1025206QE 06 
0. 10617871E 06 


0.2699 5898 E-0 1 
0.1999I209E 00 
0 • 23341884E 00 
0 . 1970664IE 00 
0 • l 6688306E 06 
0 • 24516963E 00 
0.41620504E 04 
0.19478413E 00 
0*25 187844E 06 
0 • 184576506-01 
0.24228421E 06 
0 • 23658533E 00 
0.26205094E 06 
0. 792476776-01 
0 « I9514402E 06 
0.19210885E 00 
0*17599550E 06 
0.2356I201E 00 
0.26067284E 06 


0.23325709E 00 
0 • 24328492E 00 
0.21844812E 00 
0.23806258E 00 
0.24I31398E 00 
0 • 18962175E 00 
0 • 22134913E 06 
0 • 23976462E 00 
0 • 52 169320E 05 
0 • I6898105E 00 
0 • 26082554E 06 
0.17692248E 00 
0.71304652E 05 
0*241107816 00 
0 • 22799775E 06 
0 » 22Q01Q22E 00 
0 . 22556002E 06 
0 * 18I2436IE 00 
0 • 111199 50E 06 


0.24062909E 00 
0.I6164247E 00 
0.19525691E 00 
0.I3148709E 00 
0.25805557E 06 
0.12399727E 06 
0*199515726 06 
0* 25736469E 06 
0* 16345492E 06 
0*236832876 06 


0 * 17364917E 00 
0*533670876-01 
0 • 94 94947 5 E-0 l 
0 • 21086217E 00 
0 • 22557574E 00 
0 • 104095Q7E 06 
0* 19003891 E 06 
0 • 23466077E 04 
0 • 21440689E 06 
0* 19474292E 06 


0* 62070800 E-0 1 
0 *249928 52E 00 
0.24995166E 00 
0 • 15445005E 00 
0*111778136 00 
0 .163699206 00 
0.10784204E 06 
0 • 262 14354E 06 
0*1 5936756E 06 
0 *254920976 06 


0 * L6660043E 00 
0*1 5882590E 00 
0*238294036 00 
0.13714773E 00 
0*220689126 00 
0.23841 137E 00 
0.15791176E 00 
0* 16980317E 06 
0* 22995595E 06 
0.49862561E 04 


0. 14954153E 06 


0*161 16306E 05 


0 *158302606 00 


EXAMPLE 2 (Concl’d.) 


EIGENVALUES CALCULATED IN DOUBLE PRECISION 


REAL PART 


I MAG* PART 


0*5118751 A1E 05 
0.312926280E 05 
0.312926280E 05 
-0*491 94826 IE 03 
-0*491 948261 E 03 
-0.232542987E 05 
-0.232542987E 05 
-0.298245014E 05 
-0*298245014 E 05 
-0.662951226E 04 
EIGENVALUES WITHOUT 


0 . 

0.354121555E 05 
-0*3541215556 05 
0.403799917E 05 
-0.40R799917E 05 
0.277514119E 05 
-0*2775141196 05 
0.67 1235547E 04 
-0*67 1235547E 04 
0 . 

BALANCING 


REAL PART 


IMAG. PART 


CONDITION 

0. 512044999E 

05 

0. 


0* 

0.1795E 

05 

0* 313256045E 

05 

0* 354235762E 

05 

0. 

0.1714E 

05 

0. 31 3256045E 

05 

-0.354235762E 

05 

3. 

0.1714E 

05 

0* 482451 173E 

03 

0.409187326E 

05 

0. 

0.1622E 

05 

0. 482451 173E 

03 

-0.409187326E 

05 

2* 

0.1622E 

05 

0.232766110E 

05 

0* 2778 14741E 

05 

0. 

0.1615E 

05 

0*2327661106 

05 

-0.2778 14741E 

05 

2. 

0.1615E 

05 

0* 29852041 3E 

05 

0 • 67 1 3287 10E 

04 

0. 

0.1342E 

05 

0* 29852041 3E 

05 

-0.671328710E 

04 

3. 

0* 1342E 

05 

0* 6631 75B03E 

04 

0. 


4. 

0.1374E 

05 


NORM OF MATRIX BEFORE BALANCING IS 0.13120344E 07 


NORM OF MATRIX AFTER BALANCING IS 0.23793905E 06 
NUMBER OF ITERATIONS IS 4 

EIGENVALUES WITH BALANCING 


REAL PART 


IMAG. PART 


CONDITION 

0* 51 18 74663E 

05 

0 . 


0 . 

0.6770E 

01 

0.3129259446 

05 

0.354121301E 

05 

0 . 

0.6758E 

01 

0* 31 2925944E 

05 

-0.3 5412130 IE 

05 

3. 

0.6758E 

01 

0* 49194568 1 E 

03 

0.408799607E 

05 

0 . 

0.6776E 

01 

0* 49194568 IE 

03 

-0.408799607E 

05 

2. 

0.6776E 

01 

0* 232542796E 

05 

0. 277513863E 

05 

0 . 

0.6737E 

01 

0. 232542796E 

05 

-0.277513863E 

05 

2. 

0.6737E 

01 

0.298244845E 

05 

0.671235406E 

04 

0 . 

0.6170E 

01 

0* 2982448456 

05 

-0.671235406E 

04 

4. 

0.6170E 

01 

0* 6629511 39E 

04 

0 . 


3. 

0.1425E 

01 



"The aeronautical and space activities of the United States shall he 
conducted so as to contribute . , . to the expansion of human knowl- 
edge of phenomena in the atmosphere and space. The Admhiistration 
shall provide for the widest practicable and appropriate dissemination 
of information concerning its activities and the results thereof 

— National Aeronautics and Space Act of 1958 
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